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ABSTRACT 

Objective: To compare the benefits and harms of 
third-wave cognitive therapy versus mentalisation- 
based therapy in a small sample of depressed 
participants. 

Setting: The trial was conducted at an outpatient 
psychiatric clinic for non-psychotic patients in 
Roskilde, Denmark. 

Participants: 44 consecutive adult participants 
diagnosed with major depressive disorder. 
Interventions: 18 weeks of third-wave cognitive 
therapy (n=22) versus 18 weeks of mentalisation-based 
treatment (n=22). 

Outcomes: The primary outcome was the Hamilton 
Rating Scale for Depression (HDRS) at end of 
treatment (18 weeks). Secondary outcomes were: 
remission (HDRS <8), Beck's Depression Inventory, 
Symptom Checklist 90 Revised and The WHO-Five 
Well-being Index 1999. 

Results: The trial inclusion lasted for about 2 years as 
planned but only 44 out of the planned 84 participants 
were randomised. Two mentalisation-based 
participants were lost to follow-up. The unadjusted 
analysis showed that third-wave participants compared 
with mentalisation-based participants did not differ 
significantly regarding the 18 weeks HDRS score (12.9 
vs 17.0; mean difference -4.14; 95% CI -8.30 to 
0.03; p=0.051). In the analysis adjusted for baseline 
HDRS score, the difference was favouring third-wave 
cognitive therapy (p=0.039). At 18 weeks, five of the 
third-wave participants (22.7%) were in remission 
versus none of the mentalisation-based participants 
(p=0.049). We recorded no suicide attempts or 
suicides during the intervention period in any of the 44 
participants. No significant differences were found 
between the two intervention groups on the remaining 
secondary outcomes. 

Conclusions: Third-wave cognitive therapy may be 
more effective than mentalisation-based therapy for 
depressive symptoms measured on the HDRS. 
However, more randomised clinical trials are needed to 
assess the effects of third-wave cognitive therapy and 
mentalisation-based treatment for depression. 



Strengths and limitations of this study 



■ It was possible to conduct the trial with a low 
risk of bias (adequate allocation sequence gener- 
ation, adequate allocation concealment, adequate 
blinding, no risk of selective outcome reporting, 
low risk of incomplete outcome data bias, no 
risk of 'for profit' bias), which was the primary 
strength of this randomised clinical trial. 

■ The trial also provided valuable information 
about possible intervention effects of third-wave 
cognitive therapy and mentalisation-based treat- 
ment. Our preliminary results may be used to 
design future trials including estimation of 
sample size calculations. 

■ The primary limitation of this randomised clinical 
trial was that only 44 out of the planned 84 parti- 
cipants were randomised in this small-scale trial. 



Trial registration number: Registered with Clinical 
Trials government identifier: NCT01070134. 



INTRODUCTION 
Third-wave cognitive therapy 

Prior to this trial we carried out a systematic 
review of randomised clinical trials examining 
the effects of traditional cognitive therapy 
versus no intervention for major depressive dis- 
order. 1 We found that cognitive therapy com- 
pared with no intervention seems to have a 
small statistically significant beneficial effect 
on depressive symptoms. However, we identi- 
fied only a limited number of relatively small 
randomised clinical trials all with a high risk of 
bias. 1 During the past two decades new forms 
of cognitive therapy have been developed. 
These third-wave cognitive therapies include, 
for example, acceptance and commitment 



BMJ 



Jakobsen JC, etal. BMJ Open 201 4;4:e004903. doi:1 0.1 136/bmjopen-201 4-004903 



1 



Open Access 



therapy, schema therapy, mindfulness-based cognitive 
therapy and meta-cognitive therapy 2 Especially 
mindfulness-based interventions have been implemented 
in numerous different clinical contexts in recent years. 3-5 
One meta-analysis showed that third-wave cognitive 
therapy might prevent relapse of depression, 6 and small 
trials show that third-wave cognitive therapy versus no 
intervention or treatment as usual is effective for acutely 
depressed patients. 7 8 One trial has shown comparable 
effects between cognitive therapy and third-wave cognitive 
therapy in non-melancholic depression, but the trial only 
included 45 participants. 9 

Mentalisation-based treatment 

Mentalising entails attending to mental states — holding 
'mind in mind'. 10 It is the process by which an individ- 
ual explicitly and implicitly interpret the action of 
himself or herself and others on the basis on intentional 
mental states such as wishes, needs, goals and reason. 10 

Mentalisation-based treatment is rooted in attachment 
theory and developmental psychopathology and it 
includes essentials from psychodynamic psychotherapy 
in a concurrent individual and group format. 10 Prior to 
this trial we carried out a systematic review of rando- 
mised clinical trials examining the effects of psycho- 
dynamic therapy for major depressive disorder. 11 We 
found that psychodynamic therapy versus no interven- 
tion seems to have a small statistically significant effect 
on depressive symptoms (mean difference about three 
Hamilton Rating Scale for Depression (HDRS) 
points). 11 However, we identified a limited number of 
trials, the trials were small and all the trials had a high 
risk of bias so our results might be questioned. 

Mentalisation-based therapy was originally developed 
to treat borderline personality disorder but is now also 
used to treat various other psychiatric disorders such as 
depression, eating disorders, substance abuse and per- 
sonality disorders other than borderline. 10 12 
Mentalisation-based treatment is based on the concept 
of mentalisation as described by Fonagy and Bateman, 13 
14 and is different from the more strictly defined 
mentalisation-based therapy as manualised by Karterud 
and Bateman. 13-16 In comparison with mentalisation- 
based therapy, mentalisation-based treatment used in 
this trial has a more open therapeutic stance — letting 
the patient decide the theme in an associative way. The 
therapist is less active in directing the theme in the dia- 
logue and uses interpretations. Mentalising deficits can 
be assumed to underlie depressive symptoms, 17 18 and 
many depressed patients have a comorbid personality 
disorder. 19 We did not identify any trial assessing the 
effects of mentalisation-based treatment or therapy 
versus no intervention for major depressive disorder. 11 

Third-wave cognitive therapy versus mentalisation-based 
treatment 

No randomised clinical trials or systematic reviews seem 
to have examined the effects of third-wave cognitive 



therapy versus mentalisation-based treatment or therapy 
for major depression. 20 



METHODS 

In the following, we briefly describe the methodology of 
this trial. For details please consult our registered (clini- 
cal trials.gov: NCT01070134) and published protocol. 21 

Objective 

Our objective was to compare the effect of third-wave 
cognitive therapy versus mentalisation-based therapy in a 
small sample of participants with major depressive 
disorder. 

Inclusion of participants 

The trial was conducted at a public psychiatric out- 
patient clinic only treating patients on sick leave due to 
a psychiatric disorder. Patients were referred from 
general practitioners, psychiatrists in private practice and 
medical and psychiatric departments. No special 
announcement of the trial was made to the referrers. All 
patients referred to the psychiatric clinic had a full psy- 
chiatric examination by a physician who made the pre- 
liminary psychiatric diagnoses (Diagnostic and Statistical 
Manual-IV-TR, DSM-IV-TR). 22 Eligible patients were 
then interviewed by the principal investigator (JCJ) who 
used the depression part of the structured clinical inter- 
view for DSM-IV axis I disorders (SCID I) interview 23 to 
assess whether the patient fulfilled the criteria for a 
major depressive disorder (DSM-IV-TR). 22 Before ran- 
domisation baseline assessments were carried out for all 
outcome measures and all eligible patients were assessed 
with the structured clinical Interview for DSM-IV axis II 
disorders (SCID II). 24 We chose to perform the SCID II 
assessments because we wanted to compare personality 
disorders at baseline in the two intervention groups and 
to exclude patients with schizotypal personality disorder. 

The participant had to meet all of the inclusion cri- 
teria and none of the exclusion criteria. 
Inclusion criteria 

1. Age from 18 years to 65 years. 

2. Major depressive disorder, whether fist episode or 
recurrent (DSM-IV-TR). 23 

3. Beck's Depression Inventory (BDI II) score >13 
points. 25 

4. Written informed consent. 
Exclusion criteria 

1. Current psychosis, schizophrenia or schizotypal per- 
sonality disorder (DSM-IV-TR) , 22 

2. A significant alcohol or substance abuse (assessed 
during the preliminary consultations) . 

3. Initiated or changed medical antidepressive treat- 
ment less than 6 weeks before randomisation. 

4. Pregnancy. 

5. No written informed consent. 
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Randomisation 

Eligible patients with major depressive disorder were 
randomised 1:1 to third-wave cognitive therapy versus 
mentalisation-based treatment. The Copenhagen Trial 
Unit performed the randomisation centrally, using a 
computer generated block randomisation sequence that 
was unknown to the investigators. Participant inclusion 
began in February 2010 and the last patient was rando- 
mised in July 2011. Owing to an unequal allocation of 
the trial participants to one of the two groups in the 
beginning of the trial (there were only a few participants 
in one of the groups), the block size was reduced from 
12 to 4 and a stratification variable (HDRS score >22 
points) was removed. The block sizes were at all times 
unknown to the trial investigators, and the Copenhagen 
Trial Unit performed these changes without informing 
the investigators of the changes. Otherwise, the method- 
ology was not changed after trial began. 

Interventions 

Each participant received treatment for 18 weeks. The 
two intervention groups were 'slow-open' (new patients 
entered the group continually) with a maximum of 
seven patients per group. 

The time of each of the elements in the comprehen- 
sive treatment package (see below) was planned to be 
similar in the compared intervention groups. 

Shared elements for both intervention groups 

All participants were, as part of the outpatient clinic's 
usual care, offered a communal breakfast twice a week 
and participated in group psychoeducation for 1 h a 
week. During the course of treatment, all participants 
with children were offered participation in a parent 
support group (four weekly 1-h sessions). A psychiatric 
consultant (KAL) , who was not otherwise involved in the 
interventions, assessed each participant and prescribed 
psychopharmacological treatment when needed. The 
psychiatric consultant prescribed medication according 
to the official recommendations. 26 After the first consult- 
ation, medical consultations were offered by demand of 
the participant or the therapists. 

Third-wave cognitive therapy 

The third-wave cognitive therapy consisted of one weekly 
third-wave cognitive individual psychotherapy session 
(45 min) and one weekly mindfulness-skills training 
group (1.5 h). Altogether the third-wave cognitive 
therapy consisted of 18 individual psychotherapy sessions 
(45 min) and 18 group sessions (1.5 h), a maximal total 
of 40.5 h. 

The weekly individual psychotherapy session included: 

► Introduction of the cognitive model and mindfulness. 

► Exploration of thoughts, feelings, behaviour and 
physical sensations. 

► Work on acceptance of difficult feelings and difficult 
life circumstances. 



► Work on assumptions challenged by behavioural 
experiments. 

► Self-esteem training. 

► Tools to prevent relapse. 

The weekly mindfulness-skills training group included: 

Education in the practical use of six basic mindfulness 
skills: focusing, acceptance, labelling feelings, body 
awareness, self-esteem skills and mindful communica- 
tion. The group participants were encouraged to prac- 
tice the six mindfulness skills between sessions. The 
participants went through the complete skills training 
group's programme three times during the course of 
the 18 weeks of treatment. 

The manual for the third-wave cognitive therapy was 
developed specifically for the trial and had not been used 
before in a trial setting. Details about the third-wave cog- 
nitive therapy programme is available elsewhere (http:/ / 
ctu.dk/publications/supplementary-material.aspx). 27 

Mentalisation-based treatment 

The mentalisation-based treatment consisted of a weekly 
mentalisation-based individual psychotherapy session 
(45 min) and a weekly mentalisation-based group 
therapy session (1.5 h). Altogether the mentalisation- 
based treatment consisted of 18 individual psychother- 
apy sessions (45 min) and 18 group sessions (1.5 h), a 
maximal total of 40.5 h. 

Mentalisation-based treatment imposes explicit atten- 
tion to mentalising in the therapeutic process. This is 
established by a therapeutic stance where the therapist 
aims at demonstrating a 'mentalising attitude', that is, 
validating, 'not-knowing' and curiously questioning the 
patient about feelings and thoughts. 10 16 28 The therapist 
tries to identify and intervene when the patient is not 
mentalising and assists the patient in regulating the level 
of the emotions so the patient is able to mentalise and 
to get different perspectives on life events, conflicts 
etc. 10 16 28 

At the time this project was planned there was no manual 
available for the mentalisation-based treatment. Therefore, 
we developed our own treatment manual based on mentali- 
sation principles 29 Further details about the mentalisation- 
based treatment is available elsewhere (http://ctu.dk/ 
publications/ supplementary-material.aspx) , 29 

Therapists and adherence to the intervention manuals 

Each intervention group had two therapists. The two 
third-wave cognitive therapists (one of these therapists 
was the principal investigator) and the two 
mentalisation-based therapists had comparable psycho- 
therapeutic education and experience. 

All individual sessions were recorded on an audio 
recorder and all group sessions were recorded on video. 
An experienced external psychologist not otherwise 
involved in the trial assessed the degree of adherence to 
the manuals 0-5 (0: no adherence; 1: adherence about 
20% of the time; 2: adherence about 40% of the time; 3: 
adherence about 60% of the time; 4: adherence about 
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80% of the time; 5: adherence about 100% of the time). 
The psychologist randomly selected 4x5 sessions using a 
computer program. The results showed high adherence 
to the treatment manuals for both interventions. The 
means of the ratings were: 4.6 in five sessions of individ- 
ual third-wave cognitive therapy; 4.2 in five sessions of 
third-wave cognitive group therapy; 4.2 in five sessions of 
individual mentalisation-based treatment; and 3.8 in five 
sessions of mentalisation-based group treatment. 



Outcomes 

Primary outcome 

► Score on the HDRS 30 after end of treatment at week 18. 

Secondary outcomes 

► The proportion of participants in remission after ces- 
sation of treatment at week 18. We defined remission 
as HDRS below 8. 31 

► Global Severity Index score (GSI-score) 32 on the 
Symptom Checklist 90 Revised (SCL-90-R) 32 after ces- 
sation of treatment at week 18. 

► Score on the WHO-Five Well-being Index 1999 
(WHO 5) 33 after cessation of treatment at week 18. 

► Score on the BDI II 25 after cessation of treatment at 
week 18. 

Reliability of the HDRS interviews 

Two experienced psychologists performed the Hamilton 
interviews during the trial period. Prior to the trial, the 
principal investigator and one of the psychologists both 
Hamilton interviewed eight patients at the same time 
point. The mean difference between these two HDRS 
ratings performed on the same patient at the same time 
point was —0.13 points (SD 1.25) (intraclass correlation 
coefficient 0.98; Spearman correlation 0.92) . During the 
trial both psychologists Hamilton interviewed 21 patients 
at the same time point. The mean difference between 
these two HDRS ratings performed on the same patient 
at the same time point was 0.29 points (SD 2.21; intra- 
class correlation coefficient 0.96; Spearman correlation 
0.94). All these 29 interviews were performed with both 
HDRS-raters present simultaneously. One rater inter- 
viewed and rated the interviewee and the other rater 
only rated the interviewee. The interviewers were not 
allowed to discuss the results before each interviewer 
had registered the HDRS result. 



Data-management 

All data were handled by research assistants not other- 
wise involved in the trial and was stored in the principal 
investigator's office and later at the Copenhagen Trial 
Unit. Privacy of trial participants was protected in 
accordance with the Act on Processing of Personal Data 
and the Health Act. The project was notified to the 
Danish Data Protection Agency (no. 2008-58-0020). 



Blinding 

The Hamilton interviewers were blinded to treatment 
allocation and were instructed by the principal investiga- 
tor to avoid questions beside the Hamilton interview. All 
interviewees were prior to each interview instructed by 
the principal investigator not to mention which treat- 
ment they were allocated to. It was not possible to blind 
neither the therapists nor the participants to treatment 
allocation. 

The chief consultant performing the medical consul- 
tations was, due to practical circumstances, not blinded 
to treatment allocation. 

A statistician at The Copenhagen Trial Unit per- 
formed the statistical analyses blinded with the two inter- 
vention groups coded as 'A' and 'B'. 

A priori sample size estimate 

With a 'minimal relevant mean difference' (MIREDIF) 
between the two interventions of 5 HDRS points, an a 
of 0.05 (type I error), a power of 0.90 (type II error of 
10%) and a SD of 7 HDRS points, the sample size calcu- 
lation showed that a total of 84 participants would be 
necessary. We estimated that we would need an inclusion 
period of about 2 years to recruit 84 participants. 

Statistical analyses 

The primary analyses were intention-to-treat analyses. 
Significance tests were two-sided at a significance level 
of 0.05. 

Continuous outcomes were compared between the 
two intervention groups using the univariate general 
linear model with (ANCOVA) and without HDRS base- 
line value adjustment (ANOVA). The binary outcome 
was compared between the groups using Fisher's exact 
test. Logistic regression could not be used since none of 
the participants in the mentalisation-based group 
obtained remission implying an infinite OR. 

As the trial was stopped before the sample size was 
reached, we post hoc decided to conduct sequential ana- 
lysis to assess the results of significance testing taking 
sparse data and repetitive testing into consideration. 34 
We used the trial sequential analysis programme for that 



RESULTS 
Participants 

Only 44 out of the 84 planned participants were 
included in the trial. Twenty-two participants were ran- 
domised to third-wave cognitive therapy versus 22 partici- 
pants to mentalisation-based treatment. Figure 1 details 
the participant flow through the phases of the trial. 

Baseline characteristics of the participants 

The baseline characteristics regarding age, sex, number 
of children, score on the HDRS, baseline diagnosis of 
personality disorder and psychopharmacological treat- 
ment were overall assessed as being comparable between 
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CONSORT 2010 Flow Diagram 



Enrolment 



Assessed for eligibility (n=56) 



Randomised (n=44) 



Excluded n=12 



Declined to participate n=3 
Diagnosis of schizotypal 
personality disorder n=2 
No diagnosis of major 
depressive disorder n=4 
Referred to another treatment 
n=3 



Allocation 



Allocated to third wave cognitive therapy 
(n=22) 

• Received allocated intervention (n=22) 

• Did not receive allocated intervention 
(n=0) 



Allocated to mentalisation-based therapy 
(n=22) 

• Received allocated intervention (n=20) 

• Lost to follow-up (n=l) 

• Excluded because of low treatment 
compliance (n=1) 



Analysed after 18 weeks (primary outcome) 



Included in the analysis (n=22) 



Included in the analysis (n=20) 



Figure 1 CONSORT flow chart. 



the two intervention groups. The baseline participant 
characteristics are described in detail in table 1 and the 
psychopharmacological treatment in online supplemen- 
tary material 1 . 

Treatment compliance 

None of the 22 participants randomised to third-wave cog- 
nitive therapy were lost to follow-up or excluded due to 
the fact that they participated in less than 70% of the ses- 
sions. One participant out of the 22 randomised to 
mentalisation-based treatment was lost to follow-up and 
one was excluded, as she did not attend the required 70% 
of the sessions (figure 1). The excluded participant was 
not assessed on any of the outcomes at end of treatment. 

INTERVENTION EFFECTS 
Primary outcome 

Mean score on the HDRS after end of interventions 

Participants randomised to third-wave therapy compared 
with participants randomised to mentalisation-based 
treatment did not differ significantly regarding the 
18-week HDRS scores in the unadjusted analysis (mean 
12.9, 95% CI 9.81 to 15.9 vs mean 17.0, 95% CI 14.0 to 
20.0; p=0.051). The mean difference between the two 



groups was -4.14 HDRS points (95% CI -8.30 to 0.03) 
corresponding to a Cohen's D of —0.62. The difference 
was, however, significant in the analysis adjusted for base- 
line HDRS score (p=0.039; table 2). 

Sequential analysis demonstrated that the observed sig- 
nificant findings ought to be interpreted conservatively 
as random errors due to sparse data cannot be excluded 
(figure 2). 

We did not impute missing values because only 2 out 
of 44 (4.5%) participants had missing values. 

Histograms on the data from both intervention groups 
showed that the data seem to be normally distributed. 
Using the non-parametric test the p value was 0.064. 

There was no significant interaction between the indi- 
cator of a diagnosis of a personality disorder and the 
intervention effects. This was also the case when the 
indicator was redefined as a binary quantity defined as 
any kind of personality disorder (yes/no) or as a binary 
quantity defined as personality disorder=borderline per- 
sonality disorder (yes/no). 

Secondary outcomes 

Participants in remission after cessation of treatment 

In the third-wave cognitive therapy group 22.7% (n=5) 
were in remission after cessation of treatment (defined 
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Table 1 Baseline characteristics 



Participants randomised to third-wave 
cognitive therapy (n=22) 



Participants randomised to 
mentalisation-based therapy (n=22) 



Age 



Mean (SD) 


38.5 (8.9) 


40.3 (6.8) 


Sex 






Female, n (%) 


1 8 (82) 


20 (91) 


Number of children 






Mean (SD) 


1.4 (1.2) 

i .-r y i .I—/ 


1.7 (1.1) 


Marital status, n (%) 






Single 


3 (14) 


7 (32) 


In a relationship 


6 (27) 


5 (23) 


Married 


1 2 (55) 


8 (36) 


Separated/divorced 


1 (5) 


2 (9) 


Level of education, n (%) 






Only high school diploma 


7 (32) 


3 (14) 


Medium long education 


14 (64) 


19 (86) 


Long education 


1 (5) 


0 (0) 


Baseline HDRS scores 






Mean (SD) 


22.1 (5.9) 


22.5 (4.9) 


Median 


22.5 


23.6 


Range 


7-30 


11-29 


Baseline GSI scores (SCL 90-R) 






Mean (SD) 


1 .80 (0.59) 


1.84 (0.41) 


Median 


1.72 


1.74 


Range 


0.68-2.79 


0.99-2.54 


Personality disorders, n (%) 






No personality disorder 


5 (23) 


6 (27) 


One personality disorder 


1 1 (50) 


12 (55) 


Two personality disorders 


4(18) 


3(14) 


Three or more personality disorders 


2(9) 


1 (5) 


Personality disorders diagnoses, n (%) 






Paranoid 


1 (5) 


0(0) 


Borderline 


4(18) 


1 (5) 


Avoidant 


7(32) 


5(23) 


Obsessive-compulsive 


4(18) 


3(14) 


Dependant 


1 (5) 


0(0) 


Depressive 


7(32) 


8 (36) 


Personality disorder NOS 


1 (5) 


4(18) 



HDRS, 17-item Hamilton Depression rating Scale; SCL-90-R, Global Severity Index score on the Symptom Checklist 90 Revised. 



as having HDRS <8 points) versus 0% in the 
mentalisation-based treatment group. This difference 
was significant (p=0.049; table 2). 

BDI II, 25 SCL-90-R 32 and WHO 5 33 after end of interventions 

No significant difference was found on BDI II, SCL-90-R 
(GSI-scores), or WHO 5 between the two intervention 
groups after cessation of treatment (table 2). Sequential 
analysis demonstrated that the observed insignificant 
findings ought to be interpreted conservatively as 
random errors due to sparse data cannot be excluded 
(see figure 3 regarding BDI II). 

Other outcomes 

Admissions, suicide attempts and suicides 

One of the participants randomised to third-wave cogni- 
tive therapy and two of the participants randomised to 



mentalisation-based treatment were for a short period 
(some days) admitted to a psychiatric hospital during 
the intervention period. 

We recorded no suicide attempts or suicides during 
the intervention period in any of the 44 participants. 

DISCUSSION 

Our preliminary results indicate that third-wave cognitive 
therapy compared with mentalisation-based treatment 
may be a more effective intervention for lowering 
depressive symptoms measured on the HDRS and may 
increase the probability of remission (HDRS <8 points). 
Furthermore, our trial demonstrated the feasibility of 
conducting the trial with low risks of bias. However, 
when only 44 out of the planned 84 participants (52%) 
of the projected sample size is obtained in a trial, it is 
necessary to interpret the results cautiously. Had this 
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Table 2 Effects of third-wave cognitive therapy versus mentalisation-based treatment 




Group randomised to 


Group randomised to 








third-wave cognitive 


mentalisation-based 


p Value of 


p Value of 




therapy (N=22) 


treatment (N=22) 


unadjusted 


adjusted 






End of 




End of 


analysis at end 


analysis* at end 


Outcome measure 


Baseline 


treatment 


Baseline 


treatment 


of treatment 


of treatment 


HDRS 














N 


22 


22 


21 


20 


0.051 


0.039 


Mean 


22.1 


12.9 


22.5 


17.0 






95% CI 


19.5 to 24.8 


9.81 to 15.9 


20.3 to 24.8 


14.0 to 20.0 






Remission 


0/22 


5/22 


0/21 


0/20 


0.049 


Not possible to 


(HDRS<8) N/total 












calculate 


BDI II 














N 


21 


21 


22 


17 


0.46 


0.46 


Mean 


36.8 


17.6 


36.3 


20.5 






95% CI 


32.5 to 41.1 


12.2 to 23.0 


32.1 to 40.6 


14.5 to 26.4 






SCL 90-R (GSI score) 












N 


22 


22 


22 


20 




U.DD 


Mean 


1.80 


0.88 


1.84 


1.00 






95% CI 


1 .54 to 2.05 


0.62 to 1.15 


1 .66 to 2.02 


0.74 to 1 .25 






WHO 5 














N 


22 


22 


21 


20 


0.54 


0.46 


Mean 


3.55 


10.5 


4.33 


9.45 






95% CI 


1 .84 to 5.25 


7.66 to 13.4 


3.13 to 5.53 


7.18 to 11.7 






'Adjusted for baseline values of each outcome. BDI, Beck's Depression Inventory; GSI, Global Severity Index score; HDRS, Hamilton 


Depression Rating Scale (17-item); N, number of participants; SCL 90-R, Symptom Checklist 90 Revised; WHO 5, WHO-Five Well-being 


Index 1999, a high score associates to a high level of well-being. 









been an interim analysis, any independent safety and 
data monitoring committee would have recommended 
continued randomisation and completion of the trial 
(figures 2 and 3). 34 Furthermore, the two interventions 
do not seem to have significant differential effects on 
BDI (subjective depressive symptoms), SCL 90-R (psy- 
chological distress) and WHO 5 (well-being) . 

Compared with the baseline scores, both intervention 
groups improved during the trial period on all continu- 
ous outcomes. We did not include a control group 
receiving no intervention in this head-to-head trial so it 
is unclear whether it was trial intervention effects, 
regression towards the mean or the natural progression 
of the disorder in this sample which was responsible for 
these changes. 39 More randomised clinical trials are 
needed to assess the effects of third-wave cognitive 
therapy and mentalisation-based treatment for major 
depressive disorder. 

Strengths 

First of all, the trial was conducted with an overall high 
level of methodological quality and we assessed the valid- 
ity of the trial results according to the procedure pro- 
posed by Jakobsen et aP 4 , including adjusting the 
thresholds for significance according to the number of 
randomised participants and the planned sample size. 
We also proved the feasibility of our trial design, which 
can be used for larger trials provided that funding can 
be raised. Our trial has a number of additional 
strengths: (1) The trial protocol was registered before 



randomisation began at ClinicalTrials.gov. In this proto- 
col the outcome hierarchy and plans for analyses were 
presented. Our trial was altogether conducted according 
to good clinical research practice, with low risk of bias 
(adequate allocation sequence generation, adequate 
allocation concealment, adequate blinding, no risk of 
selective outcome reporting, low risk of incomplete 
outcome data bias, no risk of 'for profit' bias) and a 
high degree of external validity. 40-44 ( 2) Both of the trial 
interventions were conducted using manuals (available 
at http:/ / ctu.dk/ publications/ supplementary-material, 
aspx) and adherence to the manuals was assessed as 
relatively high by an independent Danish psychologist 
trained in mentalisation-based therapy and third-wave 
cognitive therapy. The manualisation of the trial inter- 
ventions makes it possible, to some extent, to implement 
the two trial interventions in clinical practice and to rep- 
licate or refute our results in future trials, but both treat- 
ment manuals are currently only available in Danish, 
which limits the possibility for non-Danish speakers to 
assess the quality of the treatment manuals. We are in 
the process of translating the third-wave cognitive 
manual, which will be published at a later time point. 
The mentalisation-based treatment is described thor- 
oughly elsewhere. 13-16 Nevertheless, it is a clear limita- 
tion that the manuals are not currently available in 
English. Both the cognitive therapists and the mentalisa- 
tion therapists were involved in developing the treatment 
manuals for the respective psychotherapeutic treat- 
ments, which might make the therapist enthusiasm and 
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Figure 2 Post hoc sequential 
analysis of the results on the 
Hamilton depression rating scale 
(HDRS) after 18 weeks. Forty-two 
participants of the 44 participants 
were assessed with HDRS after 
end of treatment. The required 
information size of 83 participants 
is calculated based on minimal 
relevant mean difference of 5 
HDRS points, a type I error of 
5%, a p of 10% (power of 90%) 
and a variance of 49 35-38 These 
assumptions are similar to the 
assumptions used in 
prospectively planned sample 
size calculation of 84 participants. 
The cumulated Z-curve (blue 
curve) do not cross the sequential 
monitoring boundaries (red inner 
sloping lines) implying that there 
is a risk of random error due to 
sparse data in the estimate of a 
beneficial effect of third-wave 
cognitive therapy compared with 
mentalisation-based therapy. 



required information size = 83 
t 




thoroughness similar in the two intervention groups. 
(3) We have used the most commonly used outcomes in 
trials assessing the effects of psychotherapeutic interven- 
tions for depression (ie, HDRS and BDI). 11 30 45 46 This 
makes it possible to relate our results to results from 



other trials examining the effects of interventions for 
depression. Moreover, using HDRS as outcome makes it 
possible to perform blinded objective outcome assess- 
ment, which is a further strength of our trial. (4) The 
baseline characteristics of the trial participants as well as 



Figure 3 Post hoc sequential 
analysis of the results on Beck's 
depression inventory II (BDI II) 
after 18 weeks. Thirty-eight of the 
44 participants were assessed 
with BDI II after end of treatment. 
The required information size of 
222 participants is calculated 
based on minimal relevant mean 
difference of 5 BDI II points, a 
type I error of 5%, a p of 1 0% 
(power of 90%) and a SD of 1 1 .5 
BDI II points. 35 " 38 The cumulated 
Z-curve (blue curve) do not cross 
the sequential monitoring 
boundaries (red inner sloping 
lines) implying that there is a risk 
of random error due to sparse 
data in the estimate of no 
beneficial effect of third-wave 
cognitive therapy compared with 
mentalisation-based. 
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the psychopharmacological medication in the two 
groups were comparable which indicates that the ran- 
domisation succeeded in allocating comparable partici- 
pants to the two intervention groups. (5) Only 2 out of 
the total of 44 participants were not assessed after end 
of treatment, which decreases the risk of biased results. 47 
(6) All outcomes suggested that the participants rando- 
mised to third-wave cognitive therapy had improved 
more than the participants randomised to mentalisation- 
based treatment. This supports the validity of our results, 
even though most of these differences were 
non-significant. 

Limitations 

Our trial has a number of limitations. This small-scale 
trial was in essence failed because we only included 44 
out of the planned 84 participants. The trial inclusion 
lasted for about 2 years as planned but we had problems 
with recruiting participants. Basically, not enough eli- 
gible depressed patients were referred to the clinic 
within the planned trial period. The great advantage of 
the randomised clinical trial in general is that all known 
and unknown participant characteristics will be similar 
at baseline in compared intervention groups. 39 However, 
even though our baseline characteristics indicate similar- 
ity between the two groups on assessed baseline 
characteristics, it is unlikely that all baseline characteri- 
stics will be similar when only 44 participants are rando- 
mised. The low number of randomised participants in 
this small-scale trial increases the risks of wrong results 
due to type I errors, and type II errors 48 49 and our 
adequate trial methodology cannot necessarily compen- 
sate for these increased risks. Moreover, our results do 
not show anything about long-term effects of the two 
interventions. 

The chief consultant prescribing the psychopharmaco- 
logical treatment was not blinded to intervention alloca- 
tion. Although we assessed the psychopharmacological 
treatment to be comparable in the two randomised 
groups at cessation of the trial interventions (see online 
supplementary material 1), the lack of blinding might 
have influenced the psychopharmacological treatment. 
The chief consultant is a mentalisation-based therapist 
and was involved in developing the mentalisation-based 
treatment manual. The first author and primary investi- 
gator conducted the third-wave cognitive therapy and 
wrote the manual for the third-wave cognitive therapy 
programme, which may also increase the risks of bias. 

We did not perform power calculations for the second- 
ary outcomes before randomisation began, which is a 
further limitation. If an analysis of a secondary outcome 
has a power of less than 80%, then either the secondary 
outcome should be classified as an exploratory outcome 
or the p value and the CI thresholds for significance 
should be adjusted, just as the thresholds are adjusted if 
a sample size has not been reached. 34 

Owing to an unequal allocation of the trial partici- 
pants to one of the two groups in the beginning of the 



trial, the block size was reduced from 12 to 4 (see 
'Randomisation' section). The block sizes were at all 
times unknown to the trial investigators, and the 
Copenhagen Trial Unit performed these changes 
without informing the investigators. However, a block 
size of four is small making it possible to foresee which 
group a given eligible participant will be allocated to 
before randomisation. This might question whether the 
allocation concealment was effective. 

The trial was conducted at an outpatient psychiatric 
clinic with special interest for treatment of personality 
disorders and depressive patients were not routinely ref- 
ereed to the clinic before the trial began randomisation. 
Our results showed that a high proportion of the trial 
participants had comorbid personality disorder and 
depression. This might explain why the baseline HDRS 
scores indicated that the trial participants were only 
moderately depressed although all of the trial partici- 
pants were on sick leave due to psychological problems. 
Some of the trial participants might suffer primarily 
from psychological problem other than depressive symp- 
toms, that is, personality-related problems. We did not 
assess number of prior depressive episodes in the 
included participants, which makes it unclear whether 
our trial results demonstrate intervention effects in parti- 
cipants with a first time depression or recurrent depres- 
sion. Our results can only be related to patients 
comparable to our trial participants, that is, patients 
diagnosed with major depressive disorder on sick leave 
due to psychiatric problems. 

Highly specialised mentalisation-based treatment was 
the primary psychotherapeutic method used at the out- 
patient clinic prior to the trial, the cointerventions 
(communal breakfast and psychoeducation) were also a 
part of the treatment programme prior to the trial, and 
experienced and specialised third-wave cognitive thera- 
pists were members of the staff at the psychiatric clinic 
where the trial was conducted. Furthermore, all patients 
refereed to the psychiatric clinic were on sick leave due 
to psychiatric problems, and even though the evidence 
behind the specialised treatments is lacking we consid- 
ered that some form of specialised treatment was 
needed for all patients at the psychiatric clinic. We did, 
therefore, not consider it ethically justifiable to use a 
control group receiving no intervention, placebo or only 
the cointerventions. All these considerations and prac- 
tical circumstances led to the choice of the psychothera- 
peutic interventions and the design of this head-to-head 
trial comparing third-wave cognitive therapy and cointer- 
ventions versus mentalisation-based therapy and cointer- 
ventions. The cointerventions where delivered similarly 
to both treatment groups and the possible effects of 
cointerventions will therefore even out between the 
compared intervention groups unless there are signifi- 
cant interactions. Nevertheless, it is a clear limitation 
that our interventions are not and have not been com- 
pared versus no intervention or a more simple and basic 
form of psychotherapy plus cointerventions. 39 If a trial 
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comparing the effects of two active interventions shows 
no difference in effect it is not clear whether the two 
interventions are equally effective or equally ineffective 
— and if an experimental intervention seem superior 
compared with a control intervention then the effect 
size of the experimental intervention will be unclear 
because any beneficial or harmful effects of the control 
intervention might influence the trial results. 39 All inter- 
ventions should be assessed versus no intervention 
before being introduced into clinical practice. 39 
Furthermore, the combination of specialised psychother- 
apy and cointerventions constitute a relatively compre- 
hensive treatment, which might not always be accessible 
to psychiatric patients in clinical practice — this might 
limit the generalisability of our results. 

Mentalisation-based treatment 

We did not find any relevant treatment manual we could 
use for the mentalisation-based treatment, and we there- 
fore created our own manual (http://ctu.dk/ 
publications/supplementary-material.aspx) . 29 The thera- 
pists in the mentalisation-based treatment group were 
educated and experienced in psychodynamic therapy 
and group therapy and had underwent basic training and 
education in mentalisation-based treatment according to 
Bateman and Karterud. 13-16 Mentalisation-based treat- 
ment was originally designed to treat borderline person- 
ality. 10 12 Few participants were diagnosed with 
borderline personality disorder (table 1), and it can be 
argued that mentalisation-based treatment was not a rele- 
vant intervention for the depressed participants of this 
trial. However, mentalisation-based treatment is now used 
to treat a number of different disorders other than bor- 
derline personality disorder, including depression. 10 12 
Furthermore, a study has shown that female inpatients 
with depression showed a significantly lower capacity for 
mentalisation compared with healthy controls — and defi- 
cits in mentalising capacity were related to illness dur- 
ation, number of admissions and cognitive impairment. 17 
The authors conclude that the investigation of mentalisa- 
tion may be of particular importance for the develop- 
ment of targeted psychotherapeutic interventions for 
depression. 17 

Comorbid personality disorders 

A large proportion of the included participants were 
diagnosed with cluster C personality disorders (anxious 
or fearful personality disorders). 23 24 It has been 
debated if a diagnosis of a personality disorder is accur- 
ate when patients are acutely depressed. 19 Our results 
indicate that comorbid personality disorder and depres- 
sion does not lead to a poorer outcome compared to 
patients with depression alone — but this could be 
because the diagnoses of the personality disorders in 
our trial are inaccurate because the depressive symptoms 
might mimic pathological personality traits. 
Furthermore, the limited number of included partici- 
pants significantly reduces the power of this analysis. 



BDI compared to HDRS as outcome 

It is a common belief among clinicians that BDI is a 
more 'reactive' outcome than HDRS, 50 and it might be 
surprising to some why we identified a borderline signifi- 
cant effect on the HDRS results but no significant effect 
on the BDI. However, two systematic reviews with 
meta-analysis have included trials that simultaneously 
used HDRS and BDI to assess the effects of the same 
interventions. 50 51 The results showed that BDI under 
such circumstances shows significantly less effect sizes 
compared to the HDRS. 50 51 A greater percentage of 
participants would be considered improved if ratings of 
change were based on the HDRS rather than BDI. 50 
The results from these two reviews 50 51 are in agreement 
with our present results and may explain why we found 
a borderline significant effect on HDRS and no signifi- 
cant effect on BDI. On the other hand, it is also possible 
that HDRS compared to BDI overestimates participant 
improvement. 51 

It was impossible to blind the participants to treatment 
allocation. To ensure some degree of blinding we chose 
HDRS over BDI because it was possible to perform 
objective blinded outcome assessment using the HDRS. 
BDI is a self-administered questionnaire, which makes 
blinded objective outcome assessment impossible. We 
therefore expected the results on HDRS to be a more 
clinically valid compared to the BDI results — but we 
cannot exclude that breaking of blinding and biased 
assessment of the HDRS may have occurred. In accord- 
ance with the CONSORT Statement we did not assess 
degree of unblinding. 40 

Implications 

First of all, if a larger more definitive trial has to be con- 
ducted then a more realistic estimate of the recruitment 
rate will be needed and more centres should be 
involved. On average, we recruited approximately one 
participant every third week and we expected to be able 
to recruit approximately one participant every week. 
Basically, not enough eligible participants were referred 
to the clinic during the inclusion period and we had to 
terminate the trial due to economical and practical con- 
straints — this was the primary reason why we did not ran- 
domise more participants. Before the randomisation 
began, we did not systematically assess how many partici- 
pants it was possible to recruit. This should also be 
carried out before a larger trial is conducted so the 
sample size can be reached. Moreover, we did not take 
any specific actions promoting the trial outside the 
clinic. If a future trial is to be conducted it should be 
considered to promote the trial through advertising or 
use of other measures to motivate potential referrers to 
refer more eligible participants. Besides the problems 
with recruiting enough participants, it was otherwise 
feasible to conduct a randomised clinical trial with low 
risk of bias assessing the effects of third-wave cognitive 
therapy versus mentalisation-based treatment for major 
depressive disorder. 
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The apparent difference in intervention effect found 
on the HDRS might be caused by random error ('play 
of chance'), unaccounted bias or a signal of a real 
effect. 49 The National Institute for Health and Care 
Excellence (NICE) have suggested a mean difference 
between two compared interventions of three HDRS 
points as a criterion for 'clinical significance'. 52 Most 
interventions for depression, both psychopharmaco- 
logical as well as psychotherapeutic, rarely exceed having 
a beneficial effect of more than three HDRS points. 1 11 
53-55 used an anticipated intervention effect of five 
HDRS points to estimate the necessary sample size and 
this anticipated intervention effect was optimistic. 
Calculating Bayes factor based on the anticipated inter- 
vention effect, the observed intervention effect, and the 
SE of the observed intervention effect shows a Bayes 
factor of 0.14, which is above the recommended thresh- 
old for significance of 0.1. 34 This underlines that our 
results should be regarded as insignificant and that an 
anticipated intervention effect lower than five HDRS 
points ought to be used in sample size calculations in 
future trials assessing the effects of third-wave cognitive 
therapy and mentalisation-based therapy. We found a 
mean difference of more than four HDRS points which, 
compared to other interventions, is relatively high. 
These results might be used to calculate a necessary 
sample size in a larger more definitive trial. However, 
HDRS might not at all be a clinically relevant outcome 
and other more clinically relevant outcomes might be 
more valid to use in future trials. Severity of depression 
as measured by the total HDRS score has failed to 
predict suicide attempts, 56 57 and some publications 
have questioned the usefulness of the HDRS and con- 
cluded that the scale is psychometrically and conceptu- 
ally flawed. 57 58 
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CONCLUSIONS 

Our preliminary results show that third-wave cognitive 
therapy compared with mentalisation-based treatment 
may be a more effective intervention for depressive 
symptoms measured on the HDRS. The effects of the 
two interventions did not seem to differ significantly 
regarding BDI II, SCL 90-R and WHO 5. More rando- 
mised clinical trials are needed to assess the effects of 
third-wave cognitive therapy and mentalisation-based 
treatment. 
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